Papers by Yang Janet Liu
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work on discourse understanding is constrained by framework-dependent discourse representations. |
| Approach: | They examine whether large language models capture discourse knowledge that generalizes across languages and frameworks. |
| Outcome: | The proposed model can generalize discourse information across languages and frameworks. |
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges (2025.acl-long)
Copied to clipboard
Bolei Ma, Yuting Li, Wei Zhou, Ziwei Gong, Yang Janet Liu, Katja Jasinskaja, Annemarie Friedrich, Julia Hirschberg, Frauke Kreuter, Barbara Plank
| Challenge: | linguistics studies how context influences meaning of language and how people use it to convey implied meanings, emotions, and intentions. |
| Approach: | They analyze task designs, data collection methods, evaluation approaches and their relevance to real-world applications. |
| Outcome: | The findings highlight emerging trends, challenges, and gaps in existing benchmarks . the findings will contribute to more nuanced and context-aware NLP models . |
GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains (2024.emnlp-main)
Copied to clipboard
Yang Janet Liu, Tatsuya Aoyama, Wesley Scivetti, Yilun Zhu, Shabnam Behzad, Lauren Levine, Jessica Lin, Devika Tiwari, Amir Zeldes
| Challenge: | Existing shallow discourse parsing systems focus on the Wall Street Journal corpus, but the data is limited to the news domain and is 35 years old. |
| Approach: | They propose to use the Wall Street Journal corpus as a benchmark for PDTB-style shallow discourse parsing. |
| Outcome: | The proposed dataset is compatible with PDTB, but suffers from degradation out-of-domain. |
GCDT: A Chinese RST Treebank for Multigenre and Multilingual Discourse Parsing (2022.aacl-short)
Copied to clipboard
| Challenge: | GCDT is the largest hierarchical discourse treebank for Mandarin Chinese in the framework of Rhetorical Structure Theory (RST). |
| Approach: | They propose to use a Chinese hierarchical discourse treebank to parse Mandarin Chinese using relation inventory and a multilingual training program. |
| Outcome: | The proposed dataset includes state-of-the-art scores for Chinese RST parsing and RST Parsing on the English GUM dataset, using cross-lingual training in Chinese and English with multilingual embeddings. |
GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets are limited to newswire text, which is a fraction of extant genres in general and on the Web. |
| Approach: | They present a small but carefully crafted dataset of English summaries in 12 written and spoken genres for evaluation of abstractive summarization. |
| Outcome: | The proposed dataset of English summaries in 12 written and spoken genres is compared with human outputs and compared to untuned and prompt-based approaches. |
Why Can’t Discourse Parsing Generalize? A Thorough Investigation of the Impact of Data Diversity (2023.eacl-main)
Copied to clipboard
| Challenge: | Discourse parsing performance is not reliable for high-resource languages such as English . a heterogeneous training regime is critical for stable and generalizable models . |
| Approach: | They investigate the impact of genre diversity on RST parsing stability . they use two largest RST corpora of English with text from multiple genres . |
| Outcome: | The proposed model can generalize to text types unseen during training, but it is not reliable for high-resource languages. |
Threading the Needle: Reweaving Chain-of-Thought Reasoning to Explain Human Label Variation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown the power of chain-of-thought reasoning in improving complex decision-making tasks. |
| Approach: | They propose a pipeline that generates chain-of-thought (CoT) explanations from CoTs with improved accuracy. |
| Outcome: | The proposed pipeline outperforms a direct generation method and baselines on three datasets. |
DISRPT: A Multilingual, Multi-domain, Cross-framework Benchmark for Discourse Processing (2024.lrec-main)
Copied to clipboard
Chloé Braud, Amir Zeldes, Laura Rivière, Yang Janet Liu, Philippe Muller, Damien Sileo, Tatsuya Aoyama
| Challenge: | DISRPT is a multilingual, multi-domain, and cross-framework benchmark dataset for discourse processing. |
| Approach: | They present a multilingual, multi-domain, and cross-framework benchmark dataset for discourse processing that includes 13 languages and 24 corpora covering about 4 millions tokens and around 250,000 discourse relation instances from 4 discourse frameworks. |
| Outcome: | The DISRPT dataset includes data from 24 corpora covering about 4 millions tokens and around 250,000 discourse relation instances from 4 discourse frameworks. |